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Abstract 

By considering the Langevin dynamics of the SK spin glass with a spherical 
constraint we calculate the asymptotic distance between two real replicas that evolve 
with the same thermal noise from different initial conditions. Despite the simplicity 
of the model its dynamics is known to be non trivial and presents aging phenomena. 
We found that the asympotic distance between two replicas is maximal for a whole 
family of initial conditions that are arbitrarily close at t = 0. The asymptotic distance 
presents a dynamical transition at a temperature equal to the static phase transition 
one. 



1 Introduction 



The sensibility of the dynamics of a spins system with respect to the initial conditions has 
been extensively studied in the last years under the name of spreading of damage. This 
name was proposed in connection with biological systems where an important issue is the 
propagation of a little mutation or damage and its stability in an otherwise "normal" system 
(Kauffman 1969). In a spin system, information about the structure of phase space can be 
gained by observing the temporal evolution of the system from different initial conditions. 
Suppose we have two replicas of a system, a and r, and let them evolve in exactly the 
same external conditions (thermal noise, fields). The question then is: Are the long time 
dynamics of the two replicas sensible to small differences in initial conditions? This has 
been extensively studied in cellular automata (Martins, Verona de Resende, Tsallis and 
de Magalhaes 1991, Hinrichsen, Weitz and Domany 1996), neural networks (Tamarit and 
Curado 1994), ferromagnetic Ising models (Stanley, Stauffer, Kertesz and Herrmann 1987, 
Derrida and Weisbuch 1987) and spin glasses (Derrida 1989). The quantities of interest 
are the Hamming distance at time t between the two replicas: 



and the probability P(t) that the two replicas remain different after a time t. Different 
dynamical regimes or dynamical phase transitions can be seen by the change in the be- 
haviour of D(t) for t — > oo. For example in the heat bath dynamics of a ferromagnet the 
distance goes to zero in the paramagnetic phase and it becomes different from zero below 
T c if the initial configurations of the replicas correspond to different magnetization states. 
A little damage always heals in a heat bath ferromagnet (Vojta 1996 a,b). This result has 
a trivial interpretation in terms of the structure of phase space. 

In complex systems like spin glasses the phenomenology observed, mainly through com- 
puter simulations, is much more interesting (Derrida 1989). In general, three asymptotic 
regimes have been observed. A high temperature regime where the distance vanishes sig- 
nalling a simple phase space with only one state down to a temperature T x . This T x 
happens to coincide or be slightly smaller than the critical temperature T c of the pure 
ferromagnetic system. For Ti < T < T\ the distance goes to a nonzero value that is in- 
dependent of the initial conditions on the replicas. Finally for T < T 2 the distance goes 
to a nonzero value dependent on the initial conditions. This second temperature is near 
the spin glass transition temperature. Clearly this behaviour as T is lowered reflects the 
increasing complexity of the phase space encountered by the replicas in their dynamics. 

Extensive computer simulations done in spin glasses in dimensions 2, 3, 4 and 6 and 
mean field (Campbell and de Arcangelis 1991), and in spin glasses with asymmetric inter- 
actions (de Almeida, Bernardi and Campbell 1995), suggest that there is no dependence at 
all on the initial conditions, but this is probably because the simulations have not reached 
a sufficiently low temperature remaining at T > T 2 . 

Another important fact that may constrain the final output is the choice of the effective 
temperature of the initial conditions. Choosing random initial conditions that correspond 
to infinite temperature, the system will go through a rapid quench to the final temperature 
T. In this way it will select at random one of the accesible states at that temperature, 
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probably remaining in those of higher energy for extremely long times. Other possibility 
is to initialize the replicas in equilibrium configurations at temperatures T and T'. 

Despite the efforts done through extensive computer simulations, there are few ana- 
lytic appoaches to the spreading of damage. Golinelly and Derrida (Golinelli and Derrida 
1988) calculated the survival probability P(t) for a mean field ferromagnet and Derrida 
(Derrida 1987) obtained the solutions for D(t) in spin glasses with strongly diluted asym- 
metric interactions. Recently Vojta obtained interesting results for ferromagnets from a 
master equation approach in an effective field approximation (Vojta 1996 a,b). Trying 
to make contact with thermodynamic quantities, Coniglio, de Arcangelis, Herrmann and 
Jan (1989) have found relations between equilibrium spatial correlation functions and the 
(equilibrium) Hamming distance. Our aim in this work is to exploit the relation between 
the Hamming distance and dynamical, i.e. time dependent, correlation functions, as a way 
of extracting information of the precise dynamics of the spreading of damage process in 
complex systems. We have found analytic expressions for the distance D(t) in a simple spin 
glass model, namely the SK model with a spherical constraint. This model is known to 
have a thermodynamic phase transition to a low temperature phase with replica symmetry 
(Kosterlitz, Thouless and Jones 1976). Thus it cannot be considered a "true" spin glass and 
its phase space structure can be analyzed with great detail, at least for T — > (Kurchan 
and Laloux 1996). Despite its relative simplicity, a detailed study of the off equilibruim 
dynamics of the model (Cugliandolo and Dean 1995) revealed interesting properties like 
aging. We have studied the spreading of damage in this model finding some interesting 
peculiarities of its phase space as the exponential separation of some initially arbitrary near 
trajectories at zero temperature. On general grounds we have found a strong dependence 
of the final distance on the initial conditions and the absence of the intermediate regime 
that is consequence of the simple structure of phase space. 



2 The Model 

The spherical SK model is defined by the Hamiltonian: 

H = - jEVi' 7 ; ( 2 ) 

i¥=3 

where a^i — 1 . . . N are real valued spin variables that satisfy the constraint Y^L\ °f — N. 
The couplings between the spins are given by the quenched random variables J^-. 

A possible dynamics for the model is defined by a Langevin equation which in the basis 
of the eigenvectors of the interaction matrix reads: 

d -^ = ^-z{t))a,(t)+^(t) (3) 

where \i is the eigenvalue associated with the fj, th eigenvector, z(t) is a Lagrange multiplier 
enforcing the spherical constraint and is a thermal white noise with zero mean and 
correlations: 

(Ut)Ut')) = 2TS^S(t - t>) (4) 
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T is the temperature of the heat bath and (• • •) means an average over the thermal noise. 
The general solution of Eq.(H) is (Cugliandolo et al. 1995): 



v»{t) = a M (t )e^- to) exp|-£rfrz( 
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In this work we are interested in the time evolution of two real replicas of the system, a 
and r, that evolve with the same thermal noise. We then define the overlap between them 
at time t: 

QV) = 4 [£<^)n(d (6) 

where [■ ■ -]j means average over the disorder variables Jy. In the basis of the eigenvectors 
of J it can be expressed as 



Q(t) 



(7) 



where p(/i) is the density of eigenvalues of the interaction matrix J. A common choice is 
an ensemble of matrices with independent gaussian elements with zero mean and variance 
proportional to 1/N. In the limit of large N the eigenvalues of this ensemble are distributed 
according to the Wigner semicircle law: 
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Using the result for a^{t) (Eq.(|6|)) (setting t = 0) one obtains an expression for the overlap 
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Q(t) 



r a (t)r T (t) 



a M (0)r M (0)e 2 ^ + 2T f dt^T a {t>)T T {t>)e 

J 



2fi(t-t') 



(9) 



where T(t) = exp (2 J^dt'z(t')). Using the spherical constraint T(t) can be computed as 
the solution of a Volterra integral equation of the second kind (Cugliandolo et al. 1995): 



r(f) 
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(10) 



The spherical constraint implies T(0) = 1. 

By solving the closed equations (|) and ([10|) for different sets of initial conditions and 
using the spherical constraint we can finally calculate the distance between the two replicas 
at time t as: 

1 - Q(t) 



D(t) 



(11) 



which is a direct generalization of the Hamming distance commonly used in binary systems. 



4 



3 Results 

We have studied the asymptotic behaviour of the distance D(t) for three classes of initial 
conditions, namely: 

1. Opposite initial conditions: 0" M (O) = — r M (0). 

2. Independent initial conditions: [o" M (0)r At (0)] J = 0. 

3. Arbitrarily correlated initial conditions. This class includes as particular case ini- 
tial conditions that differ by an arbitrarily small fraction of spins as in the original 
defmtion of damage. 

In the first two classes we can even distinguish the initial conditions in two additional 
sub-classes: 

• Uniform initial conditions: cr M (0) = l,V/x. This has the same projection onto each 
eigenvector of J and corresponds to a random configuration in the original basis. 

• Staggered initial conditions: cr M (0) = \fN8 aiJi . A condition of this type has a finite 
projection onto only one eigenvector of J. 

We now proceed to present the results for each case. 



3.1 Opposite Initial Conditions 



First of all we can see immediatly that if 0^(0) = t m (0) then IV = T 7 
zero for all t, as it must. Now if M (O) = — r M (0) we still have T a (t) 
from Eqs.(g) and QTDD 
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and the distance is 
= r T (t) =T(t), but 

(12) 



3.1.1 Uniform initial condition 

In this case we have : 

'Mo)) 2 * 2 "*' 

and 

m) = if T<1. (14) 

fe=0 

where Jfe(x) is the modified Bessel function of order k. For large arguments Ik{x) ~ 
e x /y2Tix and Q(t) tends to the asymptotic value lim^oo Q(t) = Qoo = 1 — 2(1 — T) 2 . 
Consequently the asymptotic distance between the two initially opposite replicas will be: 

= (1 - Tf = q\ A (15) 

where qEA is the Edwards- Anderson order parameter that equals 1 — T in the spherical spin 
glass (Kosterlitz et al. 1976). At T = the distance is frozen and D(t) = D(0) = 1 for all 



(13) 
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times. This can be interpreted within a geometric description of phase space (Kurchan et al. 
1996): the energy has two absolute minima parallel and antiparallel in the direction of the 
maximum eigenvalue of Jy, fi = 2. Phase space is divided in two equivalent halves that are 
geometrically identical and form the basins of attraction of the two minima. Consequently 
two opposite uniform initial conditions will evolve to the two distinct minima encoutering 
in the evolution the same landscape and so preserving the distance along the way towards 
the minima, which in turn dominate the asymptotic dynamics. 

As T grows the thermal fluctuations permit the replicas to come closer to each other 
up to a value equal to the square of the self-overlap and finally merge when T goes to one 
signalling the transition to a high temperature phase characterized by D = 0, that means 
the system has a unique pure state. 



3.1.2 Staggered initial condition 

In this case [(^(O)) 2 exp (2/zt)] j = exp(2at). T(t) can't be expressed in a simple closed 
form as in the previous case so we only quote its asymptotic form that depends on the 
value of a. If a = 2 (the initial condition has a nonvanishing projection onto the maximum 
eigenvalue) then T{t) « exp (4t)/ (1 — T) and 

D 00 = l-T = q EA (16) 

The distance decreases linearly with T. Comparing with the previous case, even though 
in both cases the initial conditions are opposite, when the systems start from a random 
configuration the final distance is smaller than when they start aligned in the direction of 
the maximum eigenvalue. As was noted by Kurchan et al. (1995), at finite temperature 
the component in the direction of the maximum eigenvalue has a finite probability of 
changing sign at any time unless the initial condition is deep in a basin, this fact may be 
responsible for the different asymptotic distance between uniform and staggered (a = 2) 
initial conditions. 

If a < 2, T{t) ~ {\-t) 2 2^a 71^ G (2t)^ anc ^ ^ ne overlap asymptotically behaves as 

Q(t) « 1 - 4v^ (1 ~ r)2 (2 - a)(2tf 2 e^\ (17) 

so it relaxes exponentially to 1. This means that in the infinite time limit the distance 
between the replicas goes to zero for all T > 0. This again can be attributed to the fact 
that the initial conditions are not deep in the basins of the minima and in this case , 
although opposite, have in fact zero initial projection on them. 

If T = we can see from (||), flT0|) and ( |TTD that D(t) = 1 at all times (the distance is 



frozen). Staggered initial conditions are fixed points of the dynamics at zero temperature 
and consequently the distance between them remains maximal. 



3.2 Independent initial conditions 

Independent initial conditions satisfy / d/ip(/i)cr M (0)r A1 (0) = 0. We have studied two cases, 
one with staggered initial conditions (a < 2)in both replicas and other with uniform projec- 
tion on a subset of the eigenvectors of Jin such a way as to preserve independence between 
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the initial configurations. In both cases [0^(0)7^(0) exp (2//t)K = and the equation for 
the overlap reads: 

1 







Q(t) = , ^ 2T / dt'^T a {t')T T {t') e 2 ^ r (18) 

tr*(t)r T {t) 



3.2.1 Staggered initial conditions 

Let's consider staggered initial conditons in both replicas: 



^(0) = VNS ail 

r M (0) = VN5 bfM a^b^2. (19) 

In this case [(cx^O)) 2 exp (2fd)]j = exp (2at) and [(^(O)) 2 exp (2/xt)] J = exp (2bt). We have 
not been able to solve the integral for the overlap Eq. (|18D analytically but we have done the 
integration numerically (Linz 1985). The result for the asymptotic distance as a funtion of 
temperature is shown in Fig.(l) for two arbitrary initial conditions in different basins. 

Again at T = the dynamics is frozen and D(t) = D(0) = 0.5. Note that in the case 
of opposite initial conditions the initial overlap was Q(0) = —1 and now it is Q(0) = 0. At 
an arbitrarily small but finite temperature the final distance falls down to small values and 
already for T > 0.05 we have < 0.1. This means that although the initial configurations 
are uncorrelated they finally become very near each other, although they do not completely 
merge as was the case with opposite initial conditions. 



3.2.2 Piecewise uniform initial conditions 

We choose here initial conditions of the form: 



and 



M0) 



v(o) 



k if n < c 

if At > c 

if ji < c 

X if fM> c 



(20) 



The values of k and A depend on c through the spherical constraint: /f 2 d{ip(fi)n 2 = 1 
and J 2 djjp(jj,)X 2 = 1. For simplicity we have chosen c = so that k 2 = X 2 = 2. For the 
Gamma functions we obtained the following equations: 



r„(f) 
r T (t) 



t 

2t 



„-2t 



h{2ty 



2T / dt'Y T {t') 



(21) 
(22) 



We have solved equations (|21|), (p2[) and ( p!8|) numerically and the result for the long time 
limit is shown in Fig. (2). 

The final distance decays with temperature more like in the case of opposite initial 
conditions than in that of independent staggered ones, at each temperature the distance 
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is greater than for staggered configurations. It may be noted that while in the case of 
staggered configurations both initial states would lead to non-equilibrium dynamics (zero 
projection on the maximum eigenvalue of J), in this case one replica has a component in 
the direction a = 2 while the other has not. 



3.3 Arbitrarily correlated initial conditions 



As a final class of initial conditions we choose a pair that is arbitrarily close at t — 0. We 
considered cr M (0) = lV/z, i.e. a uniform initial condition in the firt replica and for the other 
we choose 

K if -2 < fj, < 2 - e 
if 2-e</i<2 



(23) 



In this form both initial configurations are equal if e = and have a decreasing correlation 
as e grows (0 < e < 4). The value of k as a function of e can be determined exactly from the 
spherical constraint. It turns to be n 2 = 2ir/ 



7T 



2arcsin(l - e/2) + (l-e/2)^/e(4 



Now we have to solve the full equations (U) and (|T0D. We note that in this case the 
behaviour of Q(t) at T — is different from the previous cases. For correlated initial 
conditions the distance is not frozen even at zero temperature. The expressions for the 
r(t)'s and Q{t) simplify to: 



r„(t) 
r T (t) 

Q(t) 



,2M 



;mo))v m 

M 0K(0)e 2 1 

r CT (t)r T (t) 



(24) 
(25) 

(26) 



It is straightforward to see that 



Q(t) = Q(0) t 



Tr(t) 

M r„(t) 



r T (t) 
\ r CT (t) 



(27) 



Consequently if e 7^ 0, Q(t) evolves in time even at T = 0. An explicit calculation shows 
that for any e 7^ 0, T T (t) goes asymptotically to zero while T a (t) grows exponentially for long 
times so that the overlap decays exponentially fast and the final distance is always maximal 
D(t) — > 0.5. This is somewhat surprising as it indicates that configurations with arbitrary 
initial correlation and deterministic dynamics decorrelate completely exponentially fast, 
something reminiscent of chaotic dynamics. In fact this behaviour can be understood 
looking at the geometry of phase space. At zero temperature the dynamics is deterministic 
and the asymptotic evolution dominated by the maximum eigenvalue. Consequently, a 
uniform initial condition will evolve towards a minimum. The initial condition on the 
other replica has zero projection onto the minima and its dynamics will evolve towards 
the direction of the maximum eigenvalue onto which it has an initial nonzero component. 
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Asymptotically it will reach a fixed point that will correspond, in general, to a critical 
point of high order and orthogonal to the minima, then the distance will be maximal. 
Conversely, a similar calculation considering two initial conditions with finite projection 
on the maximum eigenvalue direction shows that the configurations asymptotically merge 
and the distance goes to zero. 

For the case of finite temperature we have solved the full equations numerically and the 
result, for initial conditions of the form (p3j), is identical to that of Fig. (2) corresponding to 
independent uniform initial conditions. So, even at finite temperature, the distance grows 
and reaches a finite asymptotic value that depends on the temperature and is independent 
of e. It can be said that a little initial "damage" in a configuration propagates with time, 
the phase is "active" . 

e introduces a time scale for the decay of the correlations. In general the overlap enters 
its asymptotic regime in a time that scales as t ~ 1/e. As e becomes smaller the initial 
conditions have a larger correlation and the times needed for reaching the asymptotic 
regime grow as e . 

When both configurations present an initial projection in the direction of the maximum 
eigenvalue the asymptotic distance vanishes also in the presence of thermal noise and a 
little damage finally dissapears. 

4 Conclusions 

We have studied analytically the spreading of damage in the spherical SK model with 
Langevin dynamics. With respect to the general spreading of damage phenomenology, we 
have found that in the low temperature phase of the model the long time distance between 
the states of two real replicas of the system depend on the initial conditions on each replica. 
In this model the intermediate phase as described in the introduction is absent and the 
dynamic transition temperature at which the asymptotic distance begins to be non zero 
coincides with the static one. 

The results for zero temperature can be readily interpreted in terms of the geometry of 
phase space. The most interesting result is that two states that are initially arbitrarily close 
will flow to a maximal distance if at least one of them has vanishing initial projection onto 
the direction of the maximum eigenvalue. Conversely, if both have an initial component 
on the direction of fj, = 2 the trajectories will finally merge independently of the initial 
correlation. 

For the other classes of initial conditions considered we found that opposite or inde- 
pendent ones are fixed points for the dynamics of the distance and are in this sense less 
interesting. 

At finite temperature the asymptotic distances are simple functions of qEA for those 
initial conditions that lead asymptotically to equilibrium dynamics, i.e. those which present 
an initial condensation in the direction of the maximum eigenvalue. In these cases, when 
the inital configurations are arbitrarily close to each other they finally merge giving an 
asymptotic zero distance. 

A final comment regards the particular choice for the dynamics. It is known from 
the literature on spreading of damage that different dynamics can lead to different results 
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and so the conclusions can be model dependent. The present calculations for Langevin 
dynamics could be extended to Monte Carlo dynamics following the lines of a recent work 
(Bonilla, Padilla, Parisi and Ritort 1996). In that work it is enphasized the importance of 
the acceptance rate in the off-equilibrium dynamics of the system. For asymptotically long 
times, those which we are interested in this approach, both dyamics are equivalent and one 
expects that they will give the same results. The scale of times in which both dynamics 
are comparable depends on the acceptance rate of the Metropolis algorithm. 

The present analysis can be extended to more complicated systems which are expected 
to have a richer phenomenology. The natural extension is to consider the p-spin spherical 
model for p > 2. The study of these models is in progress. 

Acknowledgments I wish to thank D. Dean and J. Kurchan for discussions and 
comments. 
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Figure Captions 

Figure 1: Asymptotic distance vs. temperature for staggered independent initial con- 
ditions with a = —0.2 and b = 1.5 (see text). 

Figure 2: Asymptotic distance vs. temperature for piecewise uniform independent 
initial conditions. 
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